Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable NFD rule for GPU resource driver Helm chart #68

Merged
merged 8 commits into from
Jan 4, 2025

Conversation

oxxenix
Copy link
Contributor

@oxxenix oxxenix commented Dec 9, 2024

No description provided.

@oxxenix oxxenix changed the title Enable NFD rule for GPU resource driver Helm chart [WIP] Enable NFD rule for GPU resource driver Helm chart Dec 9, 2024
@oxxenix oxxenix self-assigned this Dec 9, 2024
@oxxenix oxxenix removed the request for review from softwarerecipes December 9, 2024 10:41
@oxxenix oxxenix changed the title [WIP] Enable NFD rule for GPU resource driver Helm chart Enable NFD rule for GPU resource driver Helm chart Dec 10, 2024
@oxxenix oxxenix force-pushed the gpu-nfd-rule branch 2 times, most recently from cd15249 to e5bd563 Compare December 10, 2024 11:59
@oxxenix
Copy link
Contributor Author

oxxenix commented Dec 10, 2024

@byako, @eero-t, @tkatila PTAL

@oxxenix oxxenix requested a review from mythi December 10, 2024 12:04
Copy link

@eero-t eero-t left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the initial ruleset could be simplified.

Every API exposed to users needs maintenance policy e.g. how long they're deprecated before being renamed or dropped, so exposing unneeded APIs (like labels) should be avoided.

charts/intel-gpu-resource-driver/templates/nfd.yaml Outdated Show resolved Hide resolved
charts/intel-gpu-resource-driver/templates/nfd.yaml Outdated Show resolved Hide resolved
@oxxenix oxxenix requested review from eero-t and tkatila December 16, 2024 11:37
- labels:
gpu.intel.com/product: "Max_1100"
labelsTemplate: "gpu.intel.com/device.count={{"{{"}} len .pci.device {{"}}"}}"
- labelsTemplate: "gpu.intel.com/device.count={{"{{"}} len .pci.device {{"}}"}}"
Copy link

@eero-t eero-t Dec 16, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I did not notice this earlier, but there are 4 rules for different sets of GPU IDs, each producing the same gpu.intel.com/device.count=<count> label. Which won't produce correct results on node which has GPUs from multiple rule sets.

While this is not a problem for GPU plugin because it does not support nodes with different types of Intel GPUs, DRA GPU driver is supposed to support support such use-case too.

I think it's best just to remove these rules completely for now...

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks! I removed these rules

@oxxenix oxxenix requested a review from eero-t December 29, 2024 12:35
Copy link

@eero-t eero-t left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry, I only now noticed couple of other potential issues.

tolerations: []
nodeSelector: {}
nodeSelector:
intel.feature.node.kubernetes.io/gpu: "true"
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This label will exist only with NFD. I think it's better to wrap it inside nfd.enabled check in the DaemonSet template, and remove or leave this empty (in case user wants for some reason to use his/her own label instead of NFD one):

Suggested change
intel.feature.node.kubernetes.io/gpu: "true"
# label used when nfd.enabled is true
#intel.feature.node.kubernetes.io/gpu: "true"

@oxxenix oxxenix force-pushed the gpu-nfd-rule branch 2 times, most recently from efc0923 to 32991a4 Compare December 31, 2024 14:58
Copy link

@byako byako left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@byako
Copy link

byako commented Jan 2, 2025

Default image tag value in README.md is outdated.

Copy link

@byako byako left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Versions mismatch.

@oxxenix oxxenix requested a review from byako January 3, 2025 11:59
@oxxenix oxxenix merged commit 5326261 into intel:main Jan 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants